Papers with directional ablation
Selective Steering: Norm-Preserving Control Through Discriminative Layer Selection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for inference-time steering are limited by their limitations . Angular Steering violates norm preservation, causing distribution shift and generation collapse . |
| Approach: | They propose a method that uses a norm-preserving rotation formulation to maintain activation distribution integrity and discriminative layer selection to apply steering only where features exhibit opposite-signed class alignment. |
| Outcome: | Experiments show that Selective Steering achieves higher attack success rates than prior methods while maintaining zero perplexity violations and approximately 100% capability retention on standard benchmarks. |
Can Role Vectors Affect LLM Behaviour? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has shown that personas influence LLM performance, but their direct impact remains unclear. |
| Approach: | They propose a novel approach to guiding LLM behaviour through role vectors . they construct 29 role vector derived from model activations and evaluate their impact . |
| Outcome: | The proposed approach improves in-domain task performance while yielding unexpected gains. |